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(54) Improved optimization techniques for data compression 



(57) Methods and apparatuses are provided relating 
to the encoding of data, such as, e.g., images, video, 
etc. For example, certain methods include processing 
at least a portion of data using a plurality of different 
quantization functions to produce a plurality of corre- 
sponding quantized portions of data, and selectively 
outputting one of the quantized portions of data based 
on at least one threshold value. The method may also 
include dividing initial data into a plurality of portions and 



classifying the portion of data based on at least one clas- 
sification characteristic. Here, for example, there may 
be a threshold value that is associated with the classifi- 
cation characteristic. Additional syntax may be adopted 
to enableconsiderably higher compression efficiency by 
allowing several alternative motion prediction cases. A 
high efficiency time stamp independent Direct Mode is 
also provided which considers spatial motion vector pre- 
diction as well with stationary temporal predictors. 
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Description 

RELATED PATENT APPLICATIONS 

■""dTOstarBdnOpllmlL.iooTa^ 
TECHNICAL FIELD 

BACKGROUND 

Sess^^ for compressing/encoding data and de- 

information To be PfS^^ZSJSST^^^ improvements in coding efficiency aliowformore 
increasing popularity of the Internet "an ToZruL ? S " y by com P uters a "d other like devices. With the 

isr 1 ™ gJ r systems - there is 

[0005, Additiona. I^ZS^^Z^SZ foundTa conve ^ a ' encoding methods" 

ing thesis titled "A Locally Ad^TISSj^^^l^ ? XT' " C ° mpUter 8016,106 a " d En 9 ineer ' 
at the Massachusetts Instate of iSSS Mai M Sm ^ C ° din9 "' ° y TraC ° Uy Tran whi,e 

ind 0 ^ 

efficiency versus existing systems P«^ance of RDO or other like techniques to achieve improved coding 



SUMMARY 



image, video and/or audio da,a Posing ..nous forms of data Including, but not limited to 

SSS of^tats^ ^ ^ b * a method that inc.udes processing at least a 

portions of data, and'seLive^ou^ g on SSSLSSS^LrS? hT* ° f COrres P 0ndin 9 «■«"*- 
The method may also include dividing ln£S ^ Vnto f ^ 0 " 31 ' 6aSt ° n6 thr6Sh ° ld Value - 

on at least one classification characterise Her! to examntT T ^ C ' aSSifyin9 th6 P ° rti ° n ° f data based 
the classification characteristic 6nS, ' C Here ' f ° r exam P |e ' there ™y °e a threshold value that is associated with 

T^plrt^ 

classificationcharacteri S ti c r s . ma „ i nJ..r " °'° c ^. a macrob.ock, a slit, a slice, a section, or the like. The 

a luminance characteristic, a SS^^^SSS!^ *T CharaCt6riStic ' a —othness characteristic, 
acteristic. a motion characteristic T^o^^!^^ oharactenst.c. a noise characteristic, an object char- 
characteristic, a timing characteStfc a voluml ^r! Character ' st,c - a user '"^rface focus characteristic, a layering 
characteristic, a qua.i* chaS^ a pitch characteristic, a" tone 

an encryption characteristic, or the like cnaiBCtonstie. a data type characteristic, a resolution characteristic, 

opTrle'; SS^SSSL 'oSSS^tr'^ of quantization ,unctions inc,udes at leas < ^ 

DeadzoneQuantizer, avan^^^^^ Q ™«™ ma V ba a " adaptive coverage 

the quantized portions. The method ma^furth^ 

quantized portions of data * d6 performin 9 R ate Distortion Optimization (RDO) to select the 

SaLS r' e T! ati ° n ?' an ° ther m6th ° d **— P6rf ™ in ° a « — 

parameter wrthin an encoder b2ed on ^al^otl?*^ Sett ' n9 * M °" adaptiVe " ua n«zation 
encoder. 6 charactenstIC analysis, and encoding the portion of image data with the 

[0012, ,„ yet another exempIafy implementatjon a method te provjded thgt jnc(udes ^ ^ (eas{ ^ 
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image data to be encoded using at least two different Deadzone Quantizers, and identifying preferred encoded data 
in an output of one of the at least two different Deadzone Quantizers based on a Rate Distortion Optimization (RDO) 
decision associated with at least one decision factor. 

[001 3] The above stated needs and others are also satisfied by a method that includes causing at least one portion 
s of image data to be encoded using a first Deadzone Quantizer, determining if an output of the first Deadzone Quantizer 
satisfies at least one decision factor and if so, then outputting the output of the first Deadzone Quantizer. If not, then 
causing the portion of image data to be encoded using at least a second Deadzone Quantizer that is different from the 
first Deadzone Quantizer. Here, for example, the method may also include identifying an acceptable encoded version 
of the portion of the image data based on an RDO decision or other like. 
10 [001 4] In still another exemplary implementation, a method includes performing image analysis on at least one portion 
of image data, performing block classification on the analyzed portion of image data, performing Deadzone Quantization 
of the block classified portion of image data, and performing encoding of the Deadzone Quantized portion of image 
data. Here, for example, the image analysis may include edge detection analysis, texture analysis, etc. 
[0015] In accordance with a further exemplary implementation a method is provided that includes causing at least 
one portion of video image data.to be encoded using at least two different encoders wherein at. least one of the two 
different encoders includes a Deadzone Quantizer operatively configured to support a Non Residual Mode of the video 
image data, and identifying preferred encoded frame data in an output of one of the two different encoders based on 
a Rate Distortion Optimization (RDO) decision associated with at least one decision factor. 

[001 6] Another exemplary method includes selectively varying at least one Lagrangian multiplier that is operatively 
configuring encoding logic having a quantizing function based on at least one characteristic of at least one portion of 
image data, and encoding the portion of the image data using the encoding logic. 
[001 7] In still another implementation, an exemplary method includes encoding at least a portion of video image data 
using encoder logic, and causing the encoder logic to output syntax information identifying a type of motion vector 
prediction employed by the encoder logic. 
25 [0018] A method for use in conveying video encoding related information includes encoding video data, and selec- 
tively setting at least one descriptor within a syntax portion of the encoded video data, the descriptor identifying an 
adaptive spatial/spatio-temporal encoding associated with at least one B frame encoded with the video data. Another 
method for use in conveying video encoding related information includes encoding video data, and selectively setting 
at least one descriptor within a syntax portion of the encoded video data, the descriptor identifying an adaptive copy/ 
50 motion-copy skip mode in at least one inter frame encoded with the video data. 

[0019] An exemplary method for use in a time stamp independent mode encoding of video considering stationary 
temporal/spatial portions of video frames is provided. Here, for example, the method includes selectively applying 
spatial prediction of motion associated with at least, one portion of a video frame in a video sequence, and, if temporal 
motion prediction information for a reference portion of another video frame is zero, then setting the spatial prediction 
55 of motion to zero. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0020] A more complete understanding of the various methods, apparatuses and systems of the present invention 
may be had by reference to the following detailed description when taken in conjunction with the accompanying draw- 
ings wherein: 

Fig. 1 is a block diagram that depicts an exemplary device, in the form of a computer, which is suitable for use with 
certain implementations of the present invention. 

Figs 2(a-d) are graphs depicting exemplary selectable Deadzone Quantizers, in accordance with certain imple- 
mentations of the present invention. 

Fig. 3 is a flow diagram illustrating an exemplary method for selectively applying different quantization processes 
to data, in accordance with certain implementations of the present invention. 

Fig. 4 is a block diagram depicting exemplary logic for selectively applying different quantization processes to data, 
in accordance with certain implementations of the present invention. 

Fig. 5 is a block diagram depicting exemplary logic for selectively applying different quantization processes to data, 
in accordance with certain further implementations of the present invention. 

Figs 6(a-b) are block diagrams depicting exemplary logic for selectively applying different quantization processes 
to data, in accordance with still other implementations of the present invention. 

Fig. 7 is a block diagram illustratively depicting exemplary logic for selectively applying different quantization proc- 
esses to image data, in accordance with certain implementations of the present invention. 
Fig. 8 is a chart listing exemplary syntax information for use with logic for selectively applying different prediction 
methods for motion vector, in accordance with certain implementations of the present invention. 
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Sa 9 in\ a cc^rdLcfwr, d T iCtin9 T"*"* *" SeleCtiVe,y applyin9 different encodin 9 sche ™ s * video 
data, in accordance with certain implementations of the present invention 

data' htiSEi'Sr 1 ^ PiCt i n9 K Xempla,y '° 9iC f ° r SeleCtiV8,y app,yin 9 dif,erent coding kernes to video 
data, in accordance with certain further implementations of the present invention 

Fig. 11 is an illustrative diagram certain features of a video sequence employing selectively applied encodina 
schemes, in accordance with certain implementations of the present invention Se,eCIIVely appl,ed encod '"g 
F.g. 12 is a flow diagram depicting an exemplary method for SpatioTemporal Prediction for Direct Mode video 
sequences, ,n accordance with certain implementations of the present invention. 

'0 DESCRIPTION 

EIJSS! I!! 6 ^Tk? 3, Wh0rein " ke refere " Ce nUmera,S referto ,ike elemen,s - the inventi °" *• «'««trated as 
ZrfS T computing environment. Although not required, the invention will be described in the 

« ist^2:32£r^ instructions ' such as pro9ram moduies - being executed * 2 

wh.ch may take the form of a personal computer, a workstation, a dedicated server, a plurality of processors a main 

eTL3o™ TznSlTl Pr09ra 7 m ° dU,eS inC ' Ude r0UtineS ' Pr ° 9ramS ' objects^omplenTd^ru^Zs. 
d strSld TcoZ^in ° r Imp ' ement PartiCU,ar abStraCt data *? es - The invention may a'so be practiced in 

d,str,buted computing environments where tasks are performed by remote processing devices that are linked throuah 

- i;=^7oZ^ but * computin9 — — - ™ b rs 



Exemplary Computing Environment: 

- 0 , 02 !, 1 „ f Xemplanr com P u tin9 environment 120 is only one example of a suitable computing environment and is not 

herem - Neitne r should computing environment 1 20 be interpreted as having any dependency or requirement 
so nS, 9 Th y ° r COmbmation of °™P°nents illustrated in computing environment 120 * reqU ' rement 

™S nl n ™ d methods and ^rangements herein are operational with numerous other general purpose or 
special purpose computing system environments or configurations 

^computer lloThe com^T? 9 enVir ° nment 1 20 inc,udes a general-purpose computing device in the form of 
Ls?^™ 1/ components of computer 1 30 may include one or more processors or processing units 132 a 

essoM32 3 3 C0UP ' eS Vari ° US ^ com Ponents including system memorj 134 to proc 

00^0™^^^ ^ " T* ° f "* ° f * UM **** °' DUS StrUCtUres ' inc,udi "g a memory °r memory 
!225 pe D r,pheral bus - an accelerated graphics port, and a processor or local bus using any of a variety of bus 
arch, ectures^ By way of example, and not limitation, such architectures include Industry Standard ArchSe ISA) 

a'SZp^ (MCA) bU8: Enhanced ,SA (E,SA) bus - Video e^22^2232. 0 (!£ 

t ?^ era ' ^ mp ° nent Interconnects (PC.) bus also known as Mezzanine bus. * 
P tyP,Ca " y ' nC,Udes a varietv of computer readable media. Such media may be anv available 

TmTvab: medr 8 ' 616 * ™' * ^ ^ M ° ™* ^« a^dnot 

SnrioL J" R9 ' 1 ' syste m memory 134 includes computer readable media in the form of volatile memory such as 

Z^^^S^l^r^^ SUCh " ^^memory (ROM) 138. A&EtapS 

Z n 3? (B '° S) ^ 42 ' containing the bas.c routines that help to transfer information between elements within 

Z^SXSL" dUnn9 ? tart - Up - isstoredin ROM RAM 140 typically contains data and/or prognTmod^es 
,mmed,ate| y accessible to and/or presently being operated on by processor 1 32 

mfw 1 c Computei ' 130 ma V furth er include other removable/non-removable, volatile/non-volatile computer storaoe 

vols He ITII, "'r^ 68 « hard disk drive 144 for raad -g ^m and writing lo^SSSSj3 
volatile magnetic media (not shown and typically called a "hard drive"), a magnetic disk drive 1 46 for readino from and 

72Z^ZZ^^r ,a " te T 9 r tiC dfek 148 ( a 9- a "floppy d -«"> and anZ^Ze^sZTa^t 
from or wnting to a removable, non-volatile optical disk 152 such as a CD-ROM CD-R CD-RW DVD ROM mm ram 

descnbed here.n employs a hard disk, a removable magnetic disk 148 and a removable optica, d^l 52 it shouW be 
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appreciated by those skilled in the art that other types of computer readable media which can store data that is acces- 
sible by a computer, such as magnetic cassettes, flash memory cards, digital video disks, random access memories 
(RAMs), read only memories (ROM), and the like, may also be used in the exemplary operating environment. 
[0031] A number of program modules may be stored on the hard disk, magnetic disk 148, optical disk 152, ROM 
138, or RAM 140, including, e.g., an operating system 158, one or more application programs 160, other program 
modules 162, and program data 1 64. 

[0032] The improved methods and arrangements described herein may be implemented within operating system 
158, one or more application programs 160, other program modules 162, and/or program data 164. 
[0033] A user may provide commands and information into computer 130 through input devices such as keyboard 
1 66 and pointing device 1 68 (such as a "mouse"). Other input devices (not shown) may include a microphone, joystick, 
game pad, satellite dish, serial port, scanner, camera, etc. These and other input devices are connected to the process- 
ing unit 132 through a user input interface 170 that is coupled to bus 136, but may be connected by other interface 
and bus structures, such as a parallel port, game port, or a universal serial bus (USB). 

[0034] A monitor 1 72 or other type of display device is also connected to bus 1 36 via an interface, such as a video 
adapter 174. In addition to monitor 172, personal computers typically include other peripheral output devices (not 
shown), such as speakers and printers, which may be connected through output peripheral interface 175. 
[0035] Computer 130 may operate in a networked environment using logical connections to one or more remote 
computers, such as a remote computer 182. Remote computer 182 may include many or all of the elements and 
features described herein relative to computer 130. 

[0036] Logical connections shown in Fig. 1 are a local area network (LAN) 177 and a general wide area network 
(WAN) 1 79. Such networking environments are commonplace in offices, enterprise-wide computer networks, intranets, 
and the Internet. 

[0037] When used in a LAN networking environment, computer 130 is connected to LAN 177 via network interface 
or adapter 186. When used in a WAN networking environment, the computer typically includes a modem 178 or other 
means for establishing communications over WAN 1 79. Modem 1 78, which may be internal or external, may be con- 
nected to system bus 136 via the user input interface 1 70 or other appropriate mechanism. 

[0038] Depicted in Fig. 1 , is a specific implementation of a WAN via the Internet. Here, computer 130 employs modem 
178 to establish communications with at least one remote computer 182 via the Internet 180. 

[0039] In a networked environment, program modules depicted relative to computer 130, or portions thereof, may 
be stored in a remote memory storage device. Thus, e.g., as depicted in Fig. 1 , remote application programs 189 may 
reside on a memory device of remote computer 182. It will be appreciated that the network connections shown and 
described are exemplary and other means of establishing a communications link between the computers may be used. 

Improved Rate/Distortion Optimization Techniques: 

35 

[0040] Although the following sections describe certain exemplary methods and apparatuses that are configured to 
initially compress/encode and decompress/decode image data and/or video data, those skilled in the art of data com- 
pression will recognize that the techniques presented can be adapted and employed to compress/encode and decom- 
press/decode other types of data. For example, certain methods and apparatuses may be adapted for use in com- 

40 pressing/encoding audio data, speech data and the like. 

[0041] Furthermore, although the exemplary methods and apparatuses can be configured in logic within a computer, 
those skilled in the art will recognize that such methods and apparatuses may be implemented in other types of devices! 
appliances, etc. The term "logic" as used herein is meant to include hardware, firmware, software, or any combination 
thereof, and any other supporting hardware or other mechanisms as may be required to fulfill the desired functions, 

45 either fully or partially. 

[0042] With this in mind, several exemplary schemes are presented than can be implemented in some form of logic 
to support the processing of data. 

[0043] In accordance with certain aspects of the present invention, several novel techniques are presented for im- 
proving the performance of video and/or image encoding/decoding systems. In some exemplary implementations, 
so these techniques are employed for use with image/video coding standards such as JPEG and JVT (Joint Video Team) 
Standard (e.g., H.264/AVC). By way of example, for the case of JVT, syntax changes are presented that can operatively 
enable an adaptive selection of different prediction types that can be used for predicting certain parameters of the 
video, such as, e.g., motion information. 

[0044] Rate Distortion Optimization (RDO) techniques are quite popular in video and image encoding/decoding sys- 
55 terns since they can considerably improve encoding efficiency compared to more conventional encoding methods. 
There is a continuing desire to provide even more encoding efficiency. This description describes methods and appa- 
ratuses that can significantly improve the performance of RDO or other like techniques to achieve improved coding 
efficiency versus existing systems. 
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RDol ofte^t-h* With Cert f h in ' ° f thS Present invention > one ma V also 1 urth *' ^bine and improve 

RDO or other I ke techn.ques w.th .mage pre-analysis concepts, such as, for example, edge and/or texture detection 
by using adaptive and/or variable size Deadzone quantizers depending on the charactehs?cs of Z image o ?mS 0b : 

f™L Th ' S de * Cr,ption also 'ntroduces/deflnes some additional exemplary syntax changes that can be implemented 

orTni JT^T diffSrent PrediC " 0n SCh6meS 91 8 ffame ' eVe '' f0r 6Xam P' e - imp'ovTnVthe pJr 

loTnTof ° '" 9 SCh6meS - By Way ° f eXamp,e ' ° ne techniaue arises <™ ^e fact that for some frames or 

Th^ couiri k Seq T n , C !; ^ 0t '° n ^ bS m ° re CO ' Te,ated in a tem P° ral domai " than in a spatial domain or vce versa 
This cou!d be exploited by performing a pre-analysis of the frame, but also through encoding the same frame usTna 
two or poss.Ny more different methods and seiecting a preferred method in an RDO antfor RDoTke sense The 

n3 lr« d th.„ «! k ' eXamP ' e - ° ne SUCh exem P' af y ^«thod may include the possible variation of a 
Z ^Tp framed Z * ^T" 9 " PrediCti ° n " 3 temp ° ra ' prediC,i ° n ' or a «* M°de motion vecto" 

ZTrTJ^Z ™enV*r S,ther Pr6diCted m0ti ° n VeCt ° r p -*~" " tempora "^ P- dicted """on 

rpTramL a rT Ve ~ M * neadZ ° ne Qua " tl2ati0n t0 data acc ° rdi ™ to o ne or more characteristic 

20 mfinhiJl ima9e d£ f f° mpression svstems °* the data to be compressed, such as, for example blocks or 
b coded ^Z^TTTr^f^ inf0rmati ° n th3t Whe " C ° mpared 10 0ther *^nSZSSSi 

quantfz er values Fo extno.e EES?"*, 3 qU-M * etC ) - ° ne W8y t0 aCCOm P ,ish lhis is * — 

?nf - h . eXamp,e ' In certam 'mP'ementations a smaller quantizer value may be used for "more important 
informa ion and a larger quantizer value may be used for the "less important information" However 

[0048] Attention is drawn to Figs 2(a-d), which are each illustrative graphs depicting certain exemolarv Quantizer* 
employable within certain exemp.ary image/video coding schemes. In ^F^^,S!^S^)^^Z 

lZZZ%lt l , n 7 P • ,SasS0Ciated with a Deadzone Quantization A that can considerably improve coding 

0*0491 Bv conr CeSS "^"T*** " ot e **°«"9 completely al. existing redundancies within the S^™ 9 ' 101 " 

SaZcZdZ«Z 9 n° r H "t 6 taWn9 jnt ° aCC ° Unt the im P ort an<=e of certain information within data and by 

S«Sri d ?° ne rT er 9 block/macrob, °<* example, an improvement in coding ef 

2jnr^)?JTI^^ tK° ne ' f ° r eXamp,e ' by adapti " 9 the COVera 9 e of each quantization bin (e.g., 
along tne x axis) but without chang.ng the reconstructed value. For example, compare Deadzone Quantizer 202 to 

con S ^Mh? 0 U TTfH 2 ° 4 'f 6a0d 208 ° f R9S2(b ' C ' and d) ' -aP«*ive.y. Here, JLoJZ^S^^ 
bv increl^n th 1°°^ °' COUrSe * in quantization parameters is signaled. For^xaZe 

by mcreasmg the zero bin (Fig. 2(c)) more data will be assigned to it, thus, depending on the compression scheme 

Te Z1T , S rema ' n thS SamS - EVSn th ° U9h ° ne COU,d ar 9 ue that such would impair the performance of 
fncurS fZonL T P C ° mpression 13 achievad "*o the new quantizer is considerably higher than the 

b^s 5 whJL'S '2 b o ) th f0r K XamPle ' DeadZ ° ne QUantiZer ° nly affects the zero bin versus the first positive/negate 
?S. h ♦ rema ' n the SamB 3nd thSre is n ° cha "9 e to the reconstructed value used An adaptive 

so SUP ad3PtWe eSt ' mate ° f thS Dead2 ° ne iS a,S ° P0SSib,e ( e "9- usi "9 « a ^ distortion optimization and adapte 

52LSS?S!^!!?-^ T be C ° nfi9Ured t0 characterize texture and/or edges within the image data as 
,m P ort anr information and therefore code such data in a manner to provide a higher level of auaJHv 
^cesses COnVent,0na, texture analyse/detection and edge detection algorithms to «55 23, ZSSZ 
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[0053] With this concept in mind, reference is now made to Fig. 3, which is a flow-diagram illustrating a method 300 
for selectively applying different quantization processes to data, in accordance with certain implementations of the 
present invention. In act 302, an initial data set is divided into a plurality of portions of data. For example, image or 
video data may be divided into a plurality of blocks, macroblocks, slits, slice, sections, etc. In act 304, at least one of 
5 the plurality of portions of data from act 302 is classified in some manner, for example, based on at least one charac- 
teristic or parameter. For example, the classification may be based on edge characteristics, texture characteristics, 
smoothness characteristics, luminance characteristics; chrominance characteristics, color characteristics, noise char- 
acteristics, object characteristics, motion characteristics, user preference characteristics, user interface focus charac- 
teristics, layering characteristics; timing characteristics, 1 volume characteristics, frequency characteristics, pitch char- 
ge acteristics, tone characteristics, quality characteristics, bit rate characteristics; data type characteristics, resolution 
characteristics, encryption characteristics. 

[0054] In act 306, the classified portion from act 304 is processed using at least two of a plurality of quantization 
processes to produce corresponding quantized data. In act 308, a decision is made wherein one of the quantized data 
from act 306 is selected, for example, based on satisfying at least one threshold value or measurement that is asso- 
15 ciated with the classification parameter used in act 304. In act 31 0, the quantized data from act 308 is encoded in some 
manner that allows it to be subsequently decoded. 

[0055] Using method 300, logic can be provided that essentially analyzes portions of image or video data and deems 
certain portions to be more important than others. Different Deadzone Quantizers are then applied to the more important 
data portions and the resulting quantized data analyzed to determine which Deadzone Quantizer(s) satisfy a desired 
20 threshold requirement for this more important data. For example, a quality or noise threshold requirement may be 
enforced. 

[0056] By way of further example, in video sequences edges often play a significant role in motion compensation 
techniques. This is illustrated, for example, in the block diagram depicted in Fig. 7 that is described in greater detail 
below. Basically, it is possible to perform image analysis on an image (frame) or portion thereof, and according to the 
analysis decide which one of a plurality of Deadzone Quantizers is best to use to use, for example, according to Rate 
Distortion Optimization (RDO) criterion. 
[0057] With reference to Fig. 4, logic 400 illustrates an on-the-fly decision process in accordance with certain exem- 
plary implementations of the present invention. Here, an input frame/image (or portion thereof) is subjected to image 
analysis in block 402. In this example, the image analysis includes an edge detection and/or texture analysis capability 
30 and the output is provided to a Deadzone decision block 404. Deadzone decision block 404 then causes an encoder 
406 to use a specified or otherwise selected Deadzone Quantizer or quantization value(s) when encoding the input 
frame/image (or portion thereof). 

[0058] Rather than making an on-the-fly decision regarding Deadzone Quantization, logic 500 in Fig. 5, is config- 
urable to support method 300, wherein a plurality of Deadzone Quantizers are used and an RDO decision is made 
based on certain threshold criteria. Here, an input macroblock (MB)/image 502 (or other like portion) is (selectively) 
provided to different Deadzone encoding blocks 504, 506, 508, and/or 51 0, and the outputs from of these various 
Deadzone encoding blocks are analyzed in RDO decision block 512 and the selected encoded data output.' As illus- 
trated in this example, some or all of the Deadzone encoding blocks/processes may occur in parallel. In other imple- 
mentations, such processes may be timed to occur serially. 

[0059] Fig. 6(a) and Fig. 6 (b) illustrate logic wherein a selective receding decision process is used. In Fig. 6(a), for 
example, input MB/image 502 is provided to Deadzone encoding blocks 602 and 604. A recoding decision block 606 
considers the output from Deadzone encoding block 602 and affects the selection 608 between the outputs of Deadzone 
encoding blocks 602 and 604. Recoding decision block 606 may also selectively initiate Deadzone encoding block 
604. In Fig. 6(b), logic 610 is similar to logic 600 but rather than having selection 608 associated with recoding decision 
45 block 606 includes an RDO decision block 612 that is configured to analyze the outputs from Deadzone encoding 
blocks 602 and 604 and decide which to output. 

[0060] Recoding decision block 606 in Figs 6(a, b) may be configured to make decisions based on various criteria. 
For example, in certain implementations, quality limits, rate limits and/or other RDO concepts/thresholds may be con- 
sidered. 

50 [0061] It is also possible to use the additional Deadzone quantizers only if some previously defined conditions are 
satisfied, such as for example the rate/quality is above a particular threshold. In certain exemplary a Deadzone Quan- 
tizer was successfully selected which had about a 30% larger Deadzone than the original. Other, possibly adaptive 
according to image characteristics such as AC frequencies or edge types, Deadzone quantizers may also be used. 
[0062] In Fig. 7, exemplary encoding logic 700 illustratively demonstrates how an initial image 702 (or portion thereof) 
is processed according to an image analysis process 704 to produce, in this example, edge detection data 706. Edge 
detection data 706 is then provided to a block classification process 708 to produce block classified data 710. Block 
classified data 71 0 is then provided along with initial image 702 to an image encoding process 712, which then produces 
encoded image 714. This is one example, of a simple encoding process for an image. Here, the image is analyzed (e. 
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arJ t^l^J5^2S 0rth 7 an ^ hen b ' 0CkS ^ ClaSSifiSd aCC ° rding t0 SUch '"formation. Essentially a N- 
S r ? ( ^o? 6ndS ° n ,he nUmb6r ° f Dead2ones def in * d > which later on assigns the proper Dead- 
zone (DZ) for the Quantizer (QP) assigned at Macroblock at position (ij). 

5 Consideration of non resid ual modes (e.g., for B frame Direct Mode): 

ESSdL llZ'JTT^ T* deSCription mi 9 ht ap P ear t0 be ™inly Reused on still images, the same concepts 

used i a ra her 22?" t 38 We ". eXample ' the ima9e P*»-^ and the Deadzone quantizers can be 
used in a rather straightforward manner in video compression as well 

W TntL M n !, CaS >K tha LT Peara qUite interestin 9 and can considerably benefit from the above concepts is the usage 
t? a ZZ ZT ^ ° ireCt M ° de iS baSiCa,ly 3 SpeCial m0de Which reauires no transmission of motion 

SLZ L f Ca " h ' reCtly PrediCtQd ,hrOU9h 6ither Spatial ° r temporal prediction ' Additional Wbnn-on 
rnn«? nd C °-P end,n 9 us - Provisional Patent Application Serial No. 60/385,965. 

S " " 16re ' S 00 r K f id " e to be transmitted, efficiency can be improved further by the usage of a special mode 
".h m " o dUa ' DirSCt M ° d6 ' in accordance with certain further aspects of L present invention 
here to examo^ 

'"T'^ Sma " en ° U9h and the rSdUCti0n in bitrate due t0 the hi 9" er effici ^cy of 
SSSf J I T 9 , • 3 Dead2one auantizer "W P™ide a desirable solution. The basic idea is to so- 

Z^ sZ^t^° rC T e DireCt M0d6, " nder C6rtain C ° nditi0nS ' l ° be COded without Residue though 
Iho Jn T SGhemeS b f! ed on the same conce P ts ^ in Fig. 5, for example, as shown in Fig. 9 may be implemented 

m ^jEZTl t '£? m ° de * T° FT" " thh R °° Pr0C6SS COmpared t0 a " ^availab'e modes 
eaSte o sue ^ e he perforTnance of s " c h sch *™ may not be as good as expected since the RDO used is inad- 
for ! l fn ^ i ° her processes - whlch are dependent on the Quantization values, are also affected, such as, 
fnrZn7 ' T " ^ ShOWn) *" USed X ° remove b,ockin 9 a ™ acts - More specifically, even though per- 

STSSSS? tn 9 ° 0d 31 '° Wer bit rateS ' perf °™ a " ce ™V significantly at higher bit rates; it could be 
ro0661 SimZtn h , US ! 9S ° f 3 ,ar9er qUantiZ6r and Wrth0Ut the ^deration of the Non Residual Direct Mode. 
Sic c™Z Conf SuTed T* " ""T eXamP ' eS ' accordance wit " ^ain aspects of the present invention 
L^n fr^thS Canf ' gured t0 consider such modes °n>y if some previously defined conditions are satisfied and in 
particular if the residue associated with the Direct Mode is not significant. The logic may, for example be configured 

Direct Mode 00 ! tlleCBP wS "? * ^ ^ * by «"" n,n "* ^ C ° d6d Bl °<* Pattern he 

^nnll Jt ^ k cons.denng chrominance information, is below a particular threshold then this may 

oth 6 HmLn^h T y 31 r6SidUe iS n0t 38 Signmcant and if skipped il m( 9 M not inc ur too ™ch distortion. FurtheT 

^eL3%ic K " 3Sthe 

35 nTc^resId^ eVe " fUrther by examinin 9 whether onfy the chromi- 

te 2TrZSte m„JJ f ^ Pmg a " ' UminanCe r6SidUe intaCt 11 is also possible 10 extend such incepts 

or hi™n t a macroblock that is to examine whether by sending no residue entirely, or no chrominance 

further performance - Obvi 0"sly though such could increase the encoding complexity even 

Si oTcodv'moI 0 nl 9 f '° 9iC ?° h ° W an inpUt MB/imagS 902 iS PTOVided 10 different Direc t Mode (B 

n^T!!! k ° Py . J 3meS) encodin 9 Process blocks 902, 904, 906, and 908 and the outputs from those 

m 0 «o S J£l Pr ° V,ded ,0 3 framS b3Sed RD ° deCisi0n b,ock 910 tha t selects an appropriate output 

EJ2 k iT S t0 Fig - 1 °' '° giC 1000 fUrther illustrat es how a scheme decision block 1002 and selection 1004 

^ EL '"h 8 h Pr ° Vide additi ° na ' selectabilft y de P e " d i"9 on user inputs, the application, system requ emenls 

f^esTo;S D ToiT;°? ,OCk , 10 ° 2 Sel6CtiVe,y Pr ° VideS inpUt MB/ima 9 e to one o'r more o/the Direct Mode B 
frames) or Copy Mode (Inter frames) encoding process blocks 902. 904, 906, and 908. Selection 1 004 may be controlled 
by scheme decision block 1 002 or other processes/logic/inputs. controlled 

Exemplary use o f Lagrangian multiplier for B frames: 

malbl JiSiH eC J n i qUeS h are 0ften b3Sed °" thS C ° nCeptS ° f L an9rangian Multipliers. For example, a specific mode 
may be selected that jointly minimizes distortion and bit rate. 

[0071] Such a function can be expressed as the minimization of: 

J(Mode I QP,X) = SSO{ Model QP) + X R(Mode I QP) 
where QPis the macroblock quantizer, X is the Lagrangian multiplier for mode decision, and Mode indicates the 
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macroblock mode that is to be examined and possibly selected within the RDO process. 

[0072] By way of example, in certain implementations, the Lagrangian multiplier X can be selected for Inter or Intra 
frames as: 



5 

OP 

X IP = 0.85 X 2 3 



10 



or 



Xj p = 5 x 



QP+5 
34- OP 



x exp 



OP 
10 



15 whereas in B frames, in most codecs such as JVT, this is selected as X B = 4 x X fp . 

[0073] The additional weighting of A. was done in order to give preference to lower overhead modes, since particularly 
for B frames, modes can have large overhead due to the multiple motion information transmitted, while the lower 
overhead modes, such as the Direct Mode, could still provide a very good, in terms of RDO, performance. 
[0074] Based on certain experiments in accordance with the present invention, however, it has been found that the 

20 weighting should not be constant as described above, but instead it should be dependent again on the quantizer QP 
value. 

[0075] In particular, if one defines X B = f{OF) x X I P , from these experiments it has been found that two /(QP) functions 
that could be used with much better compression efficiency than the fixed f(QP) = 4 case are: 



25 



30 and 



f(QP) = max^2.min(4^) j 



f(QP) = max^2, min(4,^j^.) j . 



[0076] This observation also comes from the fact that by having a very high X, one may also be affecting the accuracy 
of other important information, such as, for example, that of the motion prediction, which in consequence may have a 
negative impact to the encoding of the surrounding macroblocks. 

40 

Using adaptive type selection of prediction dependent MB modes: 

[0077] As also described in co-pending U.S. Provisional Patent Application Serial No. 60/385,965, co-pending U.S. 
Provisional Patent Application Serial No. 60/376,005, and co-pending U.S. Patent Application Serial No. 10/186,284, 

45 sequences and frames may have different types of dominant motion correlation. 

[0078] In particular, for small objects with constant speed in a stationary background, the usage of motion vectors 
(MVs) from temporally adjacent frames (temporal domain) enable one to perform better prediction, and yield higher 
performance. Larger objects with smooth motion may instead have higher correlation in the spatial domain (adjacent 
macroblocks), whereas in other cases information from both spatial and temporal domain may be important for the 

so prediction. These types of correlations are partly exploited, such as, for example within the Direct Mode in B and P 
frames and Skip on Motion Vector Predictor in P frames. For more information on Skip on Motion Vector Predictor in 
P frames see, e.g., Jani Lainema and Marta Karczewicz, "Skip mode motion compensation", document JVT-C027, 
JVT Meeting, Fairfax, May 2002. Thus, if the logic somehow signaJs which type of prediction is predominant at different 
frames, considerably higher performance can be achieved. 

55 [0079] Hence, in accordance with certain aspects of the present invention, the encoding logic is configured to signal 
or otherwise identify in some manner at the frame, slice, or some other like level, which prediction scheme for prediction 
dependent modes is to be used. One exemplary syntax for accomplishing this, as an example within JVT, is presented 
in chart 800 in Fig. 8. Such syntax could, of course, be modified/different in other encoding designs. 
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f-TskiZ^ 80 °' P ° SSib,e predte ">n — « flowed for the P 

zero skip mode Each one S these M °t'on-Copy pred.ct.on mode, a temporal prediction skip mode and the 

fixed size codeword in thTs 2 bTor ' Va ' Ue { °' 1 ' 2} ' WhiCh Can be coded usina • 

skilled in the art wH ecognfzeTher ways" of cLnveTn^" TT ^ ^ S(V) USing UVLC 0r CABAC >- Those 
which illustrates Picture CSS. Z?? ,h f h that n " V a ' S ° b6 emp '°y ed - ln chart 80 °- 

eration for B Frames (d^ecfmv ^aL^AH ^ « 6 add ' l '° n ° f Adaplive Spatial/Spatio-temporal consid- 
if onfy these twTmodesTre Z^Si^££S^ Copy Motion-Copy Skip mode in Inter frames (copy.mv.spatial). 
to be used (spatS predic ton w^n zero Was oToon^T T* ^ 0n ' y 1 '* thUS U( "= 1 >' but if more cases ™ 

asrr > or even r: ^*;rs;r prediction) then more bits cou,d 

logic may also make use aTpec'if* ^mode ^nS^H f heme < e 3- F '9 9) certain implementations, the encoding 
lnonepamcu.arex^ 

are shown for corresponding IkTor Direct IdTmilfl, V arr ° WS differ6n,ly Signaled P and B fra ™s • 

co-pending U.S Patent ^Ip^Z^iT!^^ PrOV,S10na ' Pat6nt Seria ' N °" 60/376 ' 005 and 

Cm modtT in p Fi9 a nd p* hT f ? meS Si9na ' differ6nt ^ 0f prediction for their corresponding Direct (B) and 

Time Stamp independent Direct Mode with the consign o f stationarv temporfll/ , T atial ^ 

t™s 

performance, but in others performance Zh hJ ™ h P ' ed,Ct,0n onl * ma * ,n some cases provide acceptable 

fh°e° ZolTce of ^^^an^ to b * - - combines 

requiring division, and/or JZS^TSiSSr^ " ""^ * ^ ^ SPatia ' PrediCt ° r Simple b * "«* 

is made when the motion SSSS^JST-llS T" ^f"* 0 " ° f D ""* M ° deS - ° ne p0SSible exce P tio " 
the motion information and reference ^ ft?!^ J"" J* temP ° ral PrBdiCt ° re 2er0 ,n SUCh 3 ~ ■ 
zero. Furthermore, the spll pZto ^hiS^l^IT!^ ° f * alS0 conside ^ to be 

subpartitions. According?, TaZ o^Zl oUhl ^l ^ cons,denn 9 a s Pa«al zero biased-ness and/or of stationary 
zero motion (or very S L ^n^r J f macroblocks ° r b '°cks to the currently predicted block have 
or part of it is and reference frame ' then also the entire macrob.ock, 
which, in particular at the Xs of 22£ ^ th °' theSe concepts he| P in Protecting stationary backgrounds, 

[0087, A P f.ow d^iSKSS^mS^ b 6 Vl6 Matob]:? SUC h h COndWOnS ^ intr ° dUCed " 
concepts using spatial prediction for tte d?m« nSS! If 16x18 Macrob| ock. 's shown .n Fig. 12. It is noted that such 
(or larger blocks or other s^ portio ns 1 7£££Z£ ZTV* ^ b '° Cks 8x8 or 4x4 > 

MV t are provided to act 1204 wherein M i I Sf L^T f ^ S MVfl ' MVb ' and MV «= and tem P or «' P^dictor 
based on MV t that leads to^ eiihel act 1208^ einMV 3 , MVa ' MVb ' "* 1206 a decision is mad o 

;s of r t h i2i d°- > is ~"^^"-Taia ^;3^ a ~ a ' — - 

ierncesTo^ 
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diction cases, especially for cases such as the Skip and Direct Mode within P and B frames respectively, which may 
be signaled at the beginning of the image. A high efficiency time stamp independent Direct Mode for B frames has 
been presented which considers spatial motion vector prediction as well with stationary temporal predictors. All or part 
of the above methods and apparatuses can be implemented to significantly improve the performance of various image/ 
video/data coding systems. 

[0089] Although some preferred implementations of the various methods and apparatuses of the present invention 
have been illustrated in the accompanying Drawings and described in the foregoing Detailed Description, it will be 
understood that the invention is not limited to the exemplary embodiments disclosed, but is capable of numerous 
rearrangements, modifications and substitutions without departing from the spirit of the invention. 

Claims 

1 . A method comprising: 

processing at least a portion of data using a plurality of different quantization functions to produce a plurality 
of corresponding quantized portions of data; and 

selectively outputting one of said quantized portions of data based on at least one threshold value. 

20 2. The method as recited in Claim 1 , further comprising: 

dividing initial data into a plurality of portions including said at least one portion of data; and 
classifying said at least one portion of data based on at least one classification characteristic. 

2s 3. The method as recited in Claim 2, wherein said at least one threshold value is associated with said at least one 
classification characteristic. 

4. The method as recited in Claim 2, wherein said initial data includes data selected from a group comprising image 
data, video data, audio data, and speech data. 

5. The method as recited in Claim 2, wherein said initial data includes image data or video data and said at least one 
portion is selected from a group comprising a block, a macroblock, a slit, a slice, and a section. 

6. The method as recited in Claim 2, wherein said at least one classification characteristic is selected from a group 
35 of characteristics comprising an edge characteristic, a texture characteristic, a smoothness characteristic, a lumi- 
nance characteristic, a chrominance characteristic, a color characteristic, a noise characteristic, an object char- 
acteristic, a motion characteristic, a user preference characteristic, a user interface focus characteristic, a layering 
characteristic, a timing characteristic, a volume characteristic, a frequency characteristic, a pitch characteristic, a 
tone characteristic, a quality characteristic, a bit rate characteristic, a data type characteristic, a resolution char- 

40 acteristic, and an encryption characteristic. 

7. The method as recited in Claim 1 , wherein said plurality of different quantization functions include at least two 
operatively different Deadzone Quantizers. 

45 8. The method as recited in Claim 7, wherein at least one of said Deadzone Quantizers includes an adaptive coverage 
Deadzone Quantizer. 

9. The method as recited in Claim 7, wherein at least one of said Deadzone Quantizers includes a variable coverage 
size Deadzone Quantizer. 



50 



55 



10. The method as recited in Claim 1 , wherein selectively outputting said one of said quantized portions of data based 
further includes: 

encoding said one of said quantized portions. 

11 . The method as recited in Claim 1 , wherein selectively outputting said one of said quantized portions of data based 
on said at least one threshold value further includes performing Rate Distortion Optimization (RDO) to select said 
one of said quantized portions of data. 
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12. A method comprising: 

performing at least one characteristic analysis on at least one portion of image data- 
chLTa^ qUamiZati ° n Pa ~ Within « ~* based on said at .east one 

encoding said at least one portion of image data with said encoder. 

13 ' I!L m Jf °h d 38 jn C ' aim 1 2 ' Wher6in Said at least one Characteristic analysis considers at least one image 

«^ZT I™/ 1 01 CharaCteristics com P--9 edge characteristic, a textureThar 

teristfc enJZZ T Ch , arac,er,st,c ' a 'finance characteristic, a chrominance characteristic, a color charac- 
enst.c a new charactenst,c, an object characteristic, a motion characteristic, a user preference characteristic a 

^SSZ^Z??™? 8 ,ay6rin9 CharaCteriStic ' 3 timi "9 Characteristic, equality chara« a 
rate characteristic, a data type characteristic, and a resolution characteristic. 

14 ' m VSSS^Tn ""I?™ 1 5 Wherei " 31 ' eaSt ° nS adaptiVS auan « zati °" Pa-meter is associated with 
an adaptive coverage Deadzone Quantizer within said encoder. 

15. The method as recited in Claim 12, wherein selectively setting said at least one adaptive quantization Parameter 
w hin sa,d encoder based on said at least one characteristic analysis is performed Ztoe^"tetoeZTa 
plurality of portions of said image data which includes a video frame. 

16. A method comprising: 

81 ' ea f ° na P ° rtion of ima 9 e data «° be encoded using at leasttwo different Deadzone Quantizers and 
.dent.fy.ngpreferredencoded data in an output of one of said at least two different Deadzone Quantizers based 
on a Rate D.stortion Optimization (RDO) decision associated with at least one decision S 

17. A method comprising: 

causing at least one portion of image data to be encoded using a first Deadzone Quantizer 

TlTTJn 9 ! I?" ° UtpUt ° f Said " rSt Dead2 °n* Quantizer satisfies at least one decision factor and 
if so, then outputting said output of said first Deadzone Quantizer, 

/nno ^ not . fhen causing said at least one portion of image data to be encoded using at least a second Dead- 
zone Quantizer that is different from said first Deadzone Quantizer. 

18. The method as recited in Claim 17, further comprising: 

19. A method comprising: 

performing image analysis on at least one portion of image data; 
performing block classification on said analyzed portion of image data- 
performing Deadzone Quantization of said block classified portion of image data- and 
performing encoding of said Deadzone Quantized portion of image data. 

2 °" fmmTn h0d 35 Claim 19 ' Wherein S8id image ana * s,s inc,udes at one type of analysis selected 

from a group comprising edge detection analysis and texture analysis. selected 

21 ' 2alS Z^MD^^l^T" b, ° Ck dassification is ^ configured based on said image 
anaiys.s and said Deadzone Quant.zat.on is operatively configured based on said block classification. 

22. A method comprising: 

« S^lT i "hT hST V ' de ° ' ma9e *"* 10 ** n* 0 ** usln 9 al leasl •»» encoder wherein 
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identifying preferred encoded frame data in an output of one of said at least two different encoders based on 
a Rate Distortion Optimization (RDO) decision associated with at least one decision factor. 

23. The method as recited in Claim 22, wherein said Deadzone Quantizer is adaptive and selectively causes said Non 
Residual Mode to be used. 

24. The method as recited in Claim 22, wherein at least one of said encoders is operatively configured to support a 
Direct Mode of said video image data. 

25. The method as recited in Claim 22, wherein at least one of said encoders is operatively configured to support a 
Copy Mode of said video image data. 

26. The method as recited in Claim 22, wherein said Non Residual Mode is operatively configured based on a Run 
Length encoding (RLC) strategy. 

27. The method as recited in Claim 22, wherein said Deadzone Quantizer is operatively adaptive. 

28. The method as recited in Claim 22, wherein said Deadzone Quantizer is operatively configured based on at least 
one characteristic associated with said at least one portion of video image data. 

29. The method as recited in Claim 22, wherein identifying said preferred encoded frame data further includes analyzing 
an amount of a residue associated with said Direct Mode frame data. 

30. The method as recited in Claim 29, wherein analyzing said amount of said residue further includes examining a 
Coded Block Pattern (CBP) of said Direct Mode frame data. 

31 . The method as recited in Claim 22, wherein said encoder having said Deadzone Quantizer is selectively configured 
to remove at least one type of residue selected from a group of residue data comprising chrominance residue data, 
luminance residue data, and all residue data. 

32. A method comprising: 

selectively varying at least one Lagrangian multiplier that is operatively configuring encoding logic having a 
quantizing function based on at least one. characteristic of at least one portion of image data; and 
encoding said at least one portion of said image data using said encoding logic. 

33. The method as recited in Claim 32, wherein said quantizing function includes a macroblock quantizer based on: 



wherein X is said Lagrangian multiplier for a mode decision and Mode indicates a macroblock mode that is 
examined using a Rate Distortion Optimization (RDO) process. 

34. The method as recited in Claim 32, wherein said Lagrangian multiplier is selected for Inter or Intra frames. 

35. The method as recited in Claim 33, wherein: 



J(Mode I QP,X) = SSD(Mode I QP) + X-R(Mode I QP) 



X = f(QP) x X 



and 
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36. The method as recited in Claim 33, wherein: 

X = f(QP) x X fp - 

and 



f(QP) = imx^2.min(4,^l)j . 

37. A method comprising: 

encoding at least a portion of video image data using encoder logic- and 

bS!!SS!^ '° 9iC t0 ° UtPUt Syn,aX inf0rmati0n identifvin 9 a ^ of m °«°" vector prediction employed 

38. The method as recited in Claim 37. wherein said encoder logic is configured to selectively employ at least one 
type of motion vector prediction selected from a group comprising spatial motion vector predion and temporal 
motion vector predion and wherein said encoder logic is configured to selectively output said synLx infoZSon 
and correspondmg encoded video image data based at .east in part on a RateVortion OpS^nTRDO) 

39. A method for use in conveying video encoding related information, the method comprising: 

encoding video data; and 

£22!* ? ' eaSt ° ne descri P tor within a syntax Potion of said encoded video data, said descriptor 

data " Spatia,/s P atio - tem P oral -coding associated with at least one B frame encoded with 

w5h a jTsZ7^Z Wh6rein enCOdin9 VidS ° d3ta inClUdeS enC0di "9 said video da < a accord 

aZJ^Tntr e T 006 descri P tor wi,hin said s V"tax portion of said encoded video data includes 

a direct_mv_spat,al parameter with a picture layer portion of said encoded video data. 

41 . A method for use in conveying video encoding related information, the method comprising: 
encoding video data; and 

£22* &etti y 81 ' eaSt ° ne descri P tor within a syntax portion of said encoded video data, said descriptor 
.denting an adaptive copy/motion^opy skip mode in at ieast one inter frame encoded wrth said video Sa 

42 ' wSh I^SZT 5 ' Wherei " • n ° 0d,n8 Vide<> data inC,Udes encodin 9 said ^ data in accord 

a lo ou ™ ^ ?' I 33 ' descri P tor within said syntax portion of said encoded video data includes 

a copy_mv_spat.al parameter with a picture layer portion of said encoded video data. 

A P o™l^ "— - — ~ 9 stationary temporal 

selSS anS ,yin9 SPatia ' PfediCti0n ° f ^ with at ,eas t one portion of a video frame in a video 

l^^^X^^ ,0r 3 referenCe «"*" °< —» ' ^ «™ " — then setting 
44. The method as recited in Claim 43, wherein said spatial prediction is spatial zero biased. 

45 ' oTher m oor o n^nT ft H ed i" °l aim Wherein SaW Spatia ' Pr6dicti0n further cons ^s stationary sub-partitions of 
th» .7 „n Tl B ° fram6, and Wherein " if at ,east one of s * d sub-partitions has a corresponding motion 
that 1S approx.mately zero, then said other portion is also considered to have zero motion " eSP ° nd ' n9 m ° b ° n 
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46. A computer-readable medium having computer implementabie instructions for configuring at least one processing 
unit to perform acts comprising: 

processing at least a portion of data using a plurality of different quantization functions to produce a plurality 
5 of corresponding quantized portions of data; and 

selectively outputting one of said quantized portions of data based on at least one threshold value. 

47. The computer-readable medium as recited in Claim 46, further comprising: 

10 dividing initial data into a plurality of portions including said at least one portion of data; and 

classifying said at least one portion of data based on at least one classification characteristic. 

48. The computer-readable medium as recited in Claim 47, wherein said at least one threshold value is associated 
with said at least one classification characteristic. 

15 

49. The computer-readable medium as recited in Claim 47, wherein said initial data includes data selected from a 
group comprising image data, video data, audio data f and speech data, and wherein said initial data includes 
image data or video data and said at least one portion is selected from a group comprising a block, a macroblock, 
a slit, a slice, and a section. 

50. The computer-readable medium as recited in Claim 47, wherein said at least one classification characteristic is 
selected from a group of characteristics comprising an edge characteristic, a texture characteristic, a smoothness 
characteristic, a luminance characteristic, a chrominance characteristic, a color characteristic, a noise character- 
istic, an object characteristic, a motion characteristic, a user preference characteristic, a user interface focus char- 
acteristic, a characteristic, a timing characteristic, a volume characteristic, a frequency characteristic, a pitch char- 
acteristic, a tone characteristic, a quality characteristic, a bit rate characteristic, a data type characteristic, a res- 
olution characteristic, and an encryption characteristic. 

51. The computer-readable medium as recited in Claim 46, wherein said plurality of different quantization functions 
30 include at least two operatively different Deadzone Quantizers and wherein at least one of said Deadzone Quan- 
tizers includes an adaptive coverage Deadzone Quantizer. 

52. The computer-readable medium as recited in Claim 46, wherein selectively outputting said one of said quantized 
portions of data based on said at least one threshold value further includes performing Rate Distortion Optimization 

35 (RDO) to select said one of said quantized portions of data. 

53. A computer-readable medium having computer implementabie instructions for configuring at least one processing 
unit to perform acts comprising: 

40 performing at least one characteristic analysis on at least one portion of image data; 

selectively setting at least one adaptive quantization parameter within an encoder based on said at least one 
characteristic analysis; and 

encoding said at least one portion of image data with said encoder. 



20 



25 



45 



54. The computer-readable medium as recited in Claim 53, wherein said at least one adaptive quantization parameter 
is associated with an adaptive coverage Deadzone Quantizer within said encoder. 



55. The computer-readable medium as recited in Claim 53, wherein selectively setting said at least one adaptive 
quantization parameter within said encoder based on said at least one characteristic analysis is performed on-the- 

so f|y while for each of a plurality of portions of said image data which includes a video frame. 

56. A computer-readable medium having computer implementabie instructions for configuring at least one processing 
unit to perform acts comprising: 



55 



causing at least one portion of image data to be encoded using at least two different Deadzone Quantizers; and 
identifying preferred encoded data in an output of one of said at least two different Deadzone Quantizers based 
on a Rate Distortion Optimization (RDO) decision associated with at least one decision factor. 
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^ 'T 1 006 POrti0 " ° f image data 10 be encoded usi "9 a 1* Deadzone Quantizer; 
TIT^T 9 L an „ OUtPUt ,° f Said f,rSt Dead20ne Q"antizer;satisfies at least one decision factor arid 
if so, then outputting sa.d output of said first Deadzone Quantizer, 

if not, then causing said at least one portion of image data to be encoded using at least a second Dead 
zone Quantizer that is different from said first Deadzone Quantizer. 

58. The computer-readable medium as recited in Claim 57, further comprising: 

69 izsrr~r" 9compu,e,imptemewabte ,ns,n,c " <,ns •"-*-»• - - . 

performing image analysis on at least one portion of image data- 
performing block classification on said analyzed portion of image data- 
performing Deadzone Quantization of said block classified portion of image data- and 
performing encoding of said Deadzone Quantized portion of image data 

60. The computer-readable medium as recited in Claim 59, wherein said image analysis includes at least one tvo e of 
analysis selected from a group comprising edge detection analysis and texture aSysT ^ 

61 IL e r^„ PU « ; ?H readable m f dlUm 38 r6Cited C ' aim 59 ' Wherein said b,ock classification is operatively configured 
clasSication ' ma96 ^ Dead2 ° ne Quanti2ation is °P^ive.y configured based on saW "block 

aTteasfo^LTn? 0 ?^ ° f Vide0 ' ma9e data t0 be enCOded usin 9 at least diffe rent encode™ wherein 
at least one of sa d two different encoders includes a Deadzone Quantizer operatively configured to suroort 
a Non Residual Mode of said video image data and conngurea to support 

a ^SST? r C ° ded ^ data an ° UtpUt ° f ° ne ° f said at least »» diffe rent coders based on 
a Rate D,stortion Opt.m.zat.on (RDO) decision associated with at least one decision factor. 

63 " ZZSZ^ttS SXTJTZT 62 ' wherein said Dead2one Quantizer is adaptive and 

67 ' -.^i^T ^ mediUm 38 reCited in C,aim 62 ' wherein said encoder having said Deadzone Quantizer is 

ch ^T- * rem ° Ve 31 ' eaSt ° ne of residue selected from • 9™uP of residue date coming 
chrom.nance residue data, luminance residue data, and all residue data. comprising 

selectively varying at least one Lagrangian multiplier that is operatively configuring encoding logic having a 
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quantizing function based on at least one characteristic of at least one portion of image data; and 
encoding said at least one portion of said image data using said encoding logic. 

69. A computer-readable medium having computer implementable instructions for configuring at least one processing ; 
unit to perform acts comprising: 

encoding at least a portion of video image data using encoder logic; and 

causing said encoder logic to output syntax information identifying a type of motion vector prediction employed 
by said encoder logic. 

70. A computer-readable medium having computer implementable instructions for configuring at least one processing 
unit to perform acts comprising: 

encoding video data; and 

15 selectively setting at least one descriptor within a syntax portion of said encoded video data, said descriptor 

identifying an adaptive spatial/spatio-temporal encoding associated with at least one B frame encoded with 
said video data. 

71. The computer-readable medium as recited in Claim 70, wherein encoding said video data includes encoding said 
20 video data in accord with a JVT Standard, and said at least one descriptor within said syntax portion of said encoded 

video data includes a direct_mv_spatial parameter with a picture layer portion of said encoded video data. 

72. A computer-readable medium having computer implementable instructions for configuring at least one processing 
unit to perform acts comprising: 

25 

encoding video data; and 

selectively setting at least one descriptor within a syntax portion of said encoded video data, said descriptor 
identifying an adaptive copy/motion-copy skip mode in at least one inter frame encoded with said video data. 

so 73. The computer-readable medium as recited in Claim 41 , wherein encoding said video data includes encoding said 
video data in accord with a JVT standard, and said at least one descriptor within said syntax portion of said encoded 
video data includes a copy_mv_spatial parameter with a picture layer portion of said encoded video data. 

74. A computer-readable medium having computer implementable instructions for configuring at least one processing 
35 unit to perform acts comprising: 

selectively applying spatial prediction of motion associated with at least one portion of a video frame in a video 
sequence; and 

if temporal motion prediction information for a reference portion of another video frame is zero, then setting 
40 said spatial prediction of motion to zero. 

75. The computer-readable medium as recited in Claim 43, wherein said spatial prediction is spatial zero biased. 

76. The computer-readable medium as recited in Claim 43, wherein said spatial prediction further considers stationary 
45 sub-partitions of other portions in said video frame, and wherein, if at least one of said sub-partitions has a corre- 
sponding motion that is approximately zero, then said other portion is also considered to have zero motion. 

77. An apparatus comprising logic operatively configured to process at least a portion of data using a plurality of 
different quantization functions to produce a plurality of corresponding quantized portions of data, and selectively 

so output one of said quantized portions of data based on at least one threshold value. 

78. The apparatus as recited in Claim 77, wherein said logic is further configured to divide initial data into a plurality 
of portions including said at least one portion of data and classify said at least one portion of data based on at 
least one classification characteristic, and wherein said at least one threshold vaJue is associated with said at least 

55 one classification characteristic. 

79. The apparatus as recited in Claim 77, wherein said plurality of different quantization functions include at least two 
operatively different Deadzone Quantizers and wherein at least one of said Deadzone Quantizers includes an 
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adaptive coverage Deadzone Quantizer. 

8 °' 2LTZTtoLT^TJ C ' ain ; 77 ' Wherein said '°9 ic is ™" configured to perform Rate Distortion Optimi- 
zation (RDO) to select said one of said quantized portions of data. ^«mi 

81 ^" apparatuS f COm P risin 9 logic operative* configured to perform at least one characteristic analysis on at least 

baseToTs^ TuHstZ T^T* r™** * M ™ P—n-JSE '« ^encode 
encoder characterise analysis, and encode said at least one portion of image data with said 

^ using'afteast SSS^'ff """^^ * ° aUSe * ,eaSt ° ne p0rtion of ima 9 e d * a to be encoded 

IZJ^Td^T^^ t Quant ! Ze,S - and identif V prefe ™* encoded data in an output of one of said 

84. An apparatus comprising logic operatively configured to cause at least one portion of imaoe data to be enoodPH 

dSn Z Quant i26r ' det6rmine if 3n ° Utput of said first D ^ne QuanS satSJs at iLst one 
decision factor and, if so, then output said output of said first Deadzone Quantizer else cause said a cZ 

srzr to be encoded usina at ieast a second Deadzone <^™iZ^™i£ z 

85 ' Je h rtio P n P o a f r sa1d atTa^nl"^ ^ "5?* Said * ' Urthar C °" f i9Ured t0 ^ an acc ^le encoded 
version of said at least one portion of said image data based on a Rate Distortion Optimization (RDO) decision. 

^ta^Prfn^ °° mpri f ina .' oaic °Peratively configured to perform image analysis on at least one portion of imaoe 

bSck IttTH^T, Sald ana ' yZed P ° rti0n ° f image data ' perform Dead2 °- QuamSon oTsS 

block classified portion of image data, and encode said Deadzone Quantized portion of image data 

87 ™H P H ratUS C °7 priSin 9 loaic operatively configured to cause at least one portion of video imaoe data to be 

^ ^ R 3r M a odeTot d : 8 e C d aim 67 ' WherSin S3id Dead2 ° ne ° UantiZer iS adapt ^ a " d — -uses said 

M ' ItTeaJt^mod; 'SS^f*** " — ° f Said 6nC0derS is operativel V -"«9ured to support 

slid'deo tmage dat ' ^ * **** ^ " ^ "«* * Cop * M "* °< 

one portion of image data, and encode said at least one portion of said image !Z££XE!^^ 
91 . An apparatus comprising logic operatively configured to encode at least a portion of video imaoe data usinn p„ m H 0 , 

M ' i.",,™ Para I" 8 c ° mp ™*"> '°S fc open>«vely configured to encode video data, and selective* set et least one d. 
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copy skip mode in at least one inter frame encoded with said video data. 

94. An apparatus comprising logic operatively configured to selectively apply spatial prediction of motion associated 
with at least one portion of a video frame in a video sequence, and if temporal motion prediction information for a 
5 reference portion of another video frame is zero then setting.said spatial prediction of motion to zero. 
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Divide a data set into a plurality of portions 
of data 



For at least one of the plurality of portions of 
data, classify the portion of data based on at 
least one classification parameter 
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Selectively apply a plurality of quantization 
processes to the classified portion of data to 
produce corresponding quantized data 
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Select between the resulting quantized data 
based on at least one threshold value 
assoicated with the at least one 
classification parameter 
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Encode the selected quantized data 
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